S3Drive - Setting up Backblaze B2 and encrypted video preview

I’ve been trying to upload videos but have had no luck. Each time it comes up with an error. At first it would stop half way but turned off the multipart upload. But now after reaching 100% I get this error which is shown in the attached picture. I wanted to see how playback works on the cloud compare to other encrypted cloud playbacks

Thank you for your report. Does this apply to testing account provided by S3Drive or is it different S3 provider?

Can you elaborate ? I’m not sure I understand what you’re asking

5:21 PM

I’m just using the free plan s3 account I made via the app. If that’s what your asking

Fair enough, there is a relevant prompt to mention that this account is for testing purposes only. In fact we're experiencing some technical issues with our S3 provider. I would recommend to register a free tier account at one of the S3 providers: https://docs.s3drive.app/setup/providers/#s3-providers create a bucket: https://docs.s3drive.app/setup/bucket/#create-a-bucket and then connect from the S3Drive. We hope to resolve these issues soon, in the meantime, recommended workflow for S3Drive is to use external provider.

S3 bucket setup - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Supported providers - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Which one would you suggest that does instant playback of videos ?

5:34 PM

And I’d s3drive not a cloud in it self ?

I personally don't have much issues with Backblaze B2. S3Drive itself is a software that connects to S3 and Rclone compatible clouds. Later this year we will be offering managed storage plans.

I just want a cloud with instant playback and with E2E but I just don’t want to wait for a video to decrypt rather wanting instant playback if it exists

6:10 PM

And does backblaze b2 have an iOS app

You'll need to install S3Drive on iOS: https://apps.apple.com/us/app/s3drive-cloud-storage/id1665135106 and then connect to Backblaze B2 (they don't have an app, they're just S3 provider). Instant playback is a function of S3Drive, not the cloud. This is because with E2E, decryption must happen on the client-side (that is S3Drive). Cloud is only a place where files are stored. Encrypted video playout is part of Ultimate / Business plan: https://docs.s3drive.app/plans/ though.

Will I be able to sort files via my phone on backblaze via s3drive or would I have to use a pc? Sorry for so many questions

6:26 PM

So whatever I put on backblaze will be decrypted for playback instantly on s3drive ?

No worries, I am here to help out. S3 provides only alphabetical order on objects, however once you enable filename encryption even alphabetical order doesn't make any sense, since encrypted filenames are just "random blobs" of data. The side effect is that with true E2E model ordering needs to happen on the client-side and that's what we allow via: "Cached mode" where you're prompted to confirm index build, which takes couple seconds to couple minutes (depending on number of files) and the sorting becomes available. Sorting is available on all platforms, including mobile. It's available for free.

So whatever I put on backblaze will be decrypted for playback instantly on s3drive ?

That's right. Since we don't have a trial available just yet, I encourage you to get the chepeast monthly subscription to test things out. If you aren't happy with what we offer we will cancel your order and refund full amount. (edited)

Tom

No worries, I am here to help out. S3 provides only alphabetical order on objects, however once you enable filename encryption even alphabetical order doesn't make any sense, since encrypted filenames are just "random blobs" of data. The side effect is that with true E2E model ordering needs to happen on the client-side and that's what we allow via: "Cached mode" where you're prompted to confirm index build, which takes couple seconds to couple minutes (depending on number of files) and the sorting becomes available. Sorting is available on all platforms, including mobile. It's available for free.

So whatever I put on backblaze will be decrypted for playback instantly on s3drive ?

That's right. Since we don't have a trial available just yet, I encourage you to get the chepeast monthly subscription to test things out. If you aren't happy with what we offer we will cancel your order and refund full amount. (edited)

As in trial for s3 or backblaze ? I currently have a free subscription for s3

7:03 PM

Appreciate your help loads

S3Drive. Speaking of Backblaze B2, you're getting 10GB storage for free, indefinitely.

Tom

S3Drive. Speaking of Backblaze B2, you're getting 10GB storage for free, indefinitely.

So I won’t know s3drive full capabilities until I use the trial right

On mobile / desktop currently yes. You can use web client though as it doesn't have any paywall currently. Bear in mind that mobile / desktop clients contain more features (sync, backup, Rclone etc.) which are not applicable to Web, so your Web experience will tell you something, but not 100%. (edited)

1

move / copy loading 30min still failed everytime every operation whaterver files space or dict amount is

mix9311

move / copy loading 30min still failed everytime every operation whaterver files space or dict amount is

That's not related to this item, please create a new one at #support and specify OS, S3Drive version and S3 provider at least.

Finally got it working with backblaze, I was wondering does s3 work with Icedrive - only because I’ve got a one terabyte cloud with them but you can’t play any encrypted file without downloading

Deleted User

Finally got it working with backblaze, I was wondering does s3 work with Icedrive - only because I’ve got a one terabyte cloud with them but you can’t play any encrypted file without downloading

There isn't any official integration with Rclone <> Icedrive, but since Icedrive supports WebDAV you could configure it using Rclone <> WebDAV. Make sure your credentials work fine: https://icedrive.net/help/account/does-icedrive-support-webdav https://webdav.icedrive.io/ Then configure on the S3Drive side: https://docs.s3drive.app/setup/providers/#webdav If you need E2E encryption then you would have to create the crypt on top of webdav: https://docs.s3drive.app/setup/providers/#client-side-encryption Bear in mind, that encrypted video playout and thumbnails aren't yet supported for Rclone back-ends, as this requires streaming interface which Rclone doesn't expose through their API. There are some other ways that we've already explored and it's possible to implement streaming, however we currently lack resources to implement that, as there are other priorities: https://s3drive.app/roadmap

Roadmap - What comes next in 2024?

MacOS native mount, iOS mount, Thumbnails, SSO integration, Managed storage plans, Folder sync on Android, Photo management tools

Supported providers - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Oh okay, btw the app is great. I may just go to koofr instead of backblaze due to more pricing options

Deleted User

Oh okay, btw the app is great. I may just go to koofr instead of backblaze due to more pricing options

Thanks for your feedback. What pricing options do you mean? Backblaze B2 is priced at $6TB/month (billed at GB increments) and the usage is calculated hourly. That means that you'll always pay for the actual usage. (edited)

I didn’t want to pay monthly

12:32 PM

I like the s3 process just looking for the right cloud for myself

12:33 PM

I thought koofr support s3 but it only supports webdav but as I just going to be using my phone to transfer files I’m just looking for convenience

Whatever works for you. If you need my help on anything just let me know.

Tom

Thanks for your feedback. What pricing options do you mean? Backblaze B2 is priced at $6TB/month (billed at GB increments) and the usage is calculated hourly. That means that you'll always pay for the actual usage. (edited)

So are you billed monthly or whenever the amount of data stored goes up ?

You're billed monthly on your usage over 10GB free tier limit. For instance if you've used 100GB for half a month and 200GB for the other half a month, then you would effectively pay for ~150GB. Given the $0.006/GB/mo, that's $0.90

5:10 PM

There are additional charges if you exceed free tier bundle, related API usage and egress (aka downloads), in order to avoid unwanted charges you can set it to minimum or even disable it using Caps and Alerts on your account: https://www.backblaze.com/docs/cloud-storage-data-caps-and-alerts (edited)

Data Caps and Alerts

With Backblaze B2 Cloud Storage, you can limit the charges that occur per day due to storage, downloads, or transaction usage.

Tom

There are additional charges if you exceed free tier bundle, related API usage and egress (aka downloads), in order to avoid unwanted charges you can set it to minimum or even disable it using Caps and Alerts on your account: https://www.backblaze.com/docs/cloud-storage-data-caps-and-alerts (edited)

By downloads do you mean decrypted files via s3drive ?

Tom

You're billed monthly on your usage over 10GB free tier limit. For instance if you've used 100GB for half a month and 200GB for the other half a month, then you would effectively pay for ~150GB. Given the $0.006/GB/mo, that's $0.90

$0.90 is a bargain

Deleted User

By downloads do you mean decrypted files via s3drive ?

Any operation that requires getting that file from the cloud. Download, open, preview, sync (e.g. locally or to other remote storage) etc.

Deleted User

$0.90 is a bargain

Yep, there is a huge value of in using cheap S3 as file storage. We're trying to make this feasible and as easy to use as we can.

Tom changed the channel name: Setting up Backblaze B2 and encrypted video preview 3/29/2024 5:43 PM

Tom

Any operation that requires getting that file from the cloud. Download, open, preview, sync (e.g. locally or to other remote storage) etc.

Damn, as I will be doing a lot of that - I’m guessing the price is just gonna exceed

7:09 PM

With Icedrive, is it possible to set up via webdav on the s3drive app ?

Deleted User

With Icedrive, is it possible to set up via webdav on the s3drive app ?

As mentioned here: https://discord.com/channels/1069654792902815845/1222953197572849714/1223181322936127499

1

Deleted User

Damn, as I will be doing a lot of that - I’m guessing the price is just gonna exceed

It really depends, free daily limits are rather generous, 2,5k transactions per day. Then $0.004 per 10,000 (Class B) or $0.004 per 1,000 (Class C). If you do some advanced syncing with lots of small files, yep you may feel the cost. Otherwise you should be fine with free tier. Key is to set up limits, to not get overcharged. That's the whole idea of pay on demand usage. The alternative is, you get the upfront storage for higher cost, but less worries. (edited)

Tom

It really depends, free daily limits are rather generous, 2,5k transactions per day. Then $0.004 per 10,000 (Class B) or $0.004 per 1,000 (Class C). If you do some advanced syncing with lots of small files, yep you may feel the cost. Otherwise you should be fine with free tier. Key is to set up limits, to not get overcharged. That's the whole idea of pay on demand usage. The alternative is, you get the upfront storage for higher cost, but less worries. (edited)

Which cloud would you suggest for upfront storage which encrypted but supports s3?

7:39 PM

I was on pcloud but there encryption is a separate price. Currently on ice drive but doesn’t support s3 but it’s okay considering I can use it for general files. And koofr doesn’t support s3 so I’m just trying to find something with an upfront cost but to be worry free interms of limit

I wouldn't say I recommend, but Wasabi is pretty reliable and don't have additional API costs: https://wasabi.com/paygo-pricing-faq/ The downside is that you're being charged upfront for 3 months for every object... so if you upload a file and delete afterwards, on Backblaze you're being charged for an hour. On Wasabi that would be 3 months. If your dataset isn't changing often, that maybe fine, otherwise, it's going to cost a lot. It's also $1 more expensive per month than Backblaze for every TB. (edited)

Richard Kellstrom

Pay-go Pricing FAQs

Below are the Frequently Asked Questions (FAQs) pertaining to Wasabi's pay-as-you-go (pay-go) pricing model.

so u think wasabi is better than cloudflare and backblaze about pricing, I' m also interested in Mega OSS upcoming.

@Tom am I doing something wrong with webdav ?

no u have to set up Rclone then u can use webdav on s3drive currently

As in I have to set up rclone on pc ?

11:56 PM

Would it work even if my pc is off after setting up ?

I'm not sure ,maybe u should ask Tom

Deleted User

@Tom am I doing something wrong with webdav ?

There must be some typo in your JSON (or maybe there some special character in the user / vendor that needs to be escaped?), but I can't spot it on the screenshot. I've tried this:

"icedrive": {
    "type": "webdav",
    "url": "https://webdav.icedrive.io",
    "user": "yourusername",
    "vendor": "something"
}

and the config gets added. Alternatively you can use full JSON format (please note additional curly braces), which you can then validate e.g. here: https://jsonlint.com/ (don't provide your username / vendor though, as they're confidential to you).

{"icedrive": {
    "type": "webdav",
    "url": "https://webdav.icedrive.io",
    "user": "yourusername",
    "vendor": "something"
}}

(edited)

mix9311

no u have to set up Rclone then u can use webdav on s3drive currently

That's not required for protocols: https://docs.s3drive.app/setup/providers/#common-protocols-configuration or non-OAuth2 providers (e.g. Proton): https://docs.s3drive.app/setup/providers/#password-based

Supported providers - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Deleted User

@Tom am I doing something wrong with webdav ?

I've think I've got it, your quotation mark is somewhat broken after the URL:

Tom

I've think I've got it, your quotation mark is somewhat broken after the URL:

I’ll try that, thank you

11:38 AM

Managed to configure but I get this error now

Validated the json without my credentials and it worked

11:53 AM

I’m guessing I’m getting the username wrong as Icedrive is just done by email and they give out a unique webdav password

Also I was trying to upload the same file I had a problem with originally but this time through the website but I still get the error

what's a vendor

This is related to CORS settings. You can set it up in the settings.

Tom

This is related to CORS settings. You can set it up in the settings.

What’s CORS ?

Tom

This is related to CORS settings. You can set it up in the settings.

I can’t find no setting for CORS Tom and why does multi part always turn on after I close the app. Also if I sign into the web browser it always makes me set up a new encryption password

Btw this is happening when directly uploading to s3drive not backblaze (edited)

If you can set up a guide for koofr vault via rclone please do @Tom, would be appreciated

Deleted User

I can’t find no setting for CORS Tom and why does multi part always turn on after I close the app. Also if I sign into the web browser it always makes me set up a new encryption password

just dowbload S3drive app then u will find CORS settings there.

mix9311

just dowbload S3drive app then u will find CORS settings there.

I don’t see it on iOS

Deleted User

Also I was trying to upload the same file I had a problem with originally but this time through the website but I still get the error

I meant this to be related to CORS settings.

Deleted User

I can’t find no setting for CORS Tom and why does multi part always turn on after I close the app. Also if I sign into the web browser it always makes me set up a new encryption password

Encryption password must be set separately on each platform, we don’t store or propagate it, it’s your secret that it’s meant to stay on your device.

Deleted User

I can’t find no setting for CORS Tom and why does multi part always turn on after I close the app. Also if I sign into the web browser it always makes me set up a new encryption password

In the settings for your S3 provider (non-S3Drive) there should be an option in the settings.

Deleted User

I can’t find no setting for CORS Tom and why does multi part always turn on after I close the app. Also if I sign into the web browser it always makes me set up a new encryption password

Regarding multipart issue, we will investigate.

Tom

Regarding multipart issue, we will investigate.

Thanks

8:17 AM

I’ve stopped using a s3 provider, I wanted to know how to set up koofr on rclone, I just didn’t know the format to write the config

Tom

I meant this to be related to CORS settings.

CORS setting doesn’t show within the app but it’s okay, I’ve chosen to use rclone but just know how to set it up

Deleted User

I’ve stopped using a s3 provider, I wanted to know how to set up koofr on rclone, I just didn’t know the format to write the config

Once I get chance I will try to setup Koofr myself and let you know. Currently out of office.

Tom

Once I get chance I will try to setup Koofr myself and let you know. Currently out of office.

Okay thanks Tom, please can you look into it sooner if possible

Deleted User

Okay thanks Tom, please can you look into it sooner if possible

Got something that worked. Set password: https://app.koofr.net/app/admin/preferences/password Obscure password: https://docs.s3drive.app/setup/providers/?h=obscu#manual-setup Use below config:

"koofr": {
    "endpoint": "https://app.koofr.net/",
    "password": "<obscuredPassword>",
    "type": "koofr",
    "user": "myuser@email.de"
},

Supported providers - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Thanks Tom I’ll try that

@Tom I’ve managed to connect my Koofr account but how can I access my safeboxes (encrypted folders) ?

Deleted User

@Tom I’ve managed to connect my Koofr account but how can I access my safeboxes (encrypted folders) ?

It seems that since 2023, Koofr uses Rclone compatible encryption, that's good: https://koofr.eu/blog/posts/how-to-set-up-client-side-encryption-of-your-koofr-files-with-rclone In such case you can set it up as for every other Rclone compatible back-end using crypt: https://docs.s3drive.app/setup/providers/#manual-setup

11:11 PM

Out of curiosity. Given that you have Koofr account, what's your main reason behind trying to set it up using S3Drive instead of Koofr client?

Playback, I wanted to encrypt my files and use rclone so I don’t have to download the video each and everytime

3:43 AM

I was thinking of instead of getting a NAS box, I could store old tv shows and watch it via kodi and through s3drive on my phone

3:44 AM

What would I write as the config for the encrypted folders in rclone

Deleted User

I’ve been trying to upload videos but have had no luck. Each time it comes up with an error. At first it would stop half way but turned off the multipart upload. But now after reaching 100% I get this error which is shown in the attached picture. I wanted to see how playback works on the cloud compare to other encrypted cloud playbacks

Hi again, this is to let you know that we've resolved these issues. Uploads should no longer fail and listings / reads shall be pretty fast now.

1

Deleted User

I was thinking of instead of getting a NAS box, I could store old tv shows and watch it via kodi and through s3drive on my phone

You can set up MinIO on NAS box and access your files using S3 / S3Drive. If you possess NAS, then you don't really need to encrypt your files, so you could preview your files through Kodi, as it won't be able to preview encrypted ones.

Tom

You can set up MinIO on NAS box and access your files using S3 / S3Drive. If you possess NAS, then you don't really need to encrypt your files, so you could preview your files through Kodi, as it won't be able to preview encrypted ones.

I don’t have a NAS hence using Koofr. Having a NAS would consume to much electricity even on low consumption

Deleted User

I don’t have a NAS hence using Koofr. Having a NAS would consume to much electricity even on low consumption

Ah sorry, I've misread your comment. In such case you could expose unencrypted files to your Kodi instance via crypt / mount combination. I am not sure exactly whether encrypted video streaming works seamlessly that way though. (edited)

Tom

Ah sorry, I've misread your comment. In such case you could expose unencrypted files to your Kodi instance via crypt / mount combination. I am not sure exactly whether encrypted video streaming works seamlessly that way though. (edited)

That’s fine, via kodi would be a bonus. Main cause it so I can have encrypted playback on my phone via rclone rather than waiting for the video to download

Deleted User

That’s fine, via kodi would be a bonus. Main cause it so I can have encrypted playback on my phone via rclone rather than waiting for the video to download

That's on the radar, but our priorities are more around S3 itself and managed plans. Squeezing Rclone to the limits will come next. Realistically that would be 2024/2025 item.

Okay, but could you help me configure Koofrs encrypted folders so I can access them via s3drive ?

3:58 PM

As I’ve subscribed to s3drive solely for the decrypted playback

Deleted User

Okay, but could you help me configure Koofrs encrypted folders so I can access them via s3drive ?

I will try to setup Koofr Vault and then configure it from S3Drive. I will let you know hopefully later today whether I've succeeded or not.

1

Deleted User

As I’ve subscribed to s3drive solely for the decrypted playback

Bear in mind that this is limited currently to S3 endpoints, which Koofr doesn't support.

Tom

Bear in mind that this is limited currently to S3 endpoints, which Koofr doesn't support.

Yeah I’m aware, I just want to see if it would work with rclone (edited)

Deleted User

Yeah I’m aware, I just want to see if it would work with rclone (edited)

I've configured S3Drive with Koofr Vault without trouble, please use this support item for Koofr / Vault related discussion: https://discord.com/channels/1069654792902815845/1225178242873298994

Tom

I've configured S3Drive with Koofr Vault without trouble, please use this support item for Koofr / Vault related discussion: https://discord.com/channels/1069654792902815845/1225178242873298994

Couldn’t figure out do I config both codes in the same rclone config or how to do it. Also do I need to state the safe box name ?

Deleted User

Couldn’t figure out do I config both codes in the same rclone config or how to do it. Also do I need to state the safe box name ?

I've replied to you in the other post to keep things organized https://discord.com/channels/1069654792902815845/1225178242873298994/1226451650466549792

Tom

I've replied to you in the other post to keep things organized https://discord.com/channels/1069654792902815845/1225178242873298994/1226451650466549792

Didn’t understand how to configure to rclone, too techsavy for me

Rclone such difficult to me ,same as Alist...